Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

convert : add BertForMaskedLM #10919

Merged
merged 1 commit into from
Dec 21, 2024
Merged

convert : add BertForMaskedLM #10919

merged 1 commit into from
Dec 21, 2024

Conversation

ggerganov
Copy link
Owner

@ggerganov ggerganov commented Dec 20, 2024

Seems like the most used BERT models are of type BertForMaskedLM - not sure why these were never added to the convert scripts.

https://huggingface.co/google-bert/bert-base-uncased

@github-actions github-actions bot added the python python script changes label Dec 20, 2024
@ggerganov ggerganov merged commit 5cd85b5 into master Dec 21, 2024
7 checks passed
@ggerganov ggerganov deleted the gg/bert-add-variant branch December 21, 2024 08:10
@neavo
Copy link

neavo commented Dec 21, 2024

QQ截图20241222000106

The multi-lingual version using the BPE tokenizer seems not to work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
python python script changes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants